Protecting eyewitness evidence: Examining the efficacy of a self-administered interview tool

Given the crucial role of eyewitness evidence, statements should be obtained as soon as possible after an incident. This is not always achieved due to demands on police resources. Two studies trace the development of a new tool, the Self-Administered Interview (SAI), designed to elicit a comprehensive initial statement. In Study 1, SAI participants reported more correct details than participants who provided a free recall account, and performed at the same level as participants given a Cognitive Interview. In Study 2, participants viewed a simulated crime and half recorded their statement using the SAI. After a delay of 1 week, all participants completed a free recall test. SAI participants recalled more correct details in the delayed recall task than control participants

Situational judgement tests in medical education and training: Research, theory and practice: AMEE Guide No. 100

Why use SJTs? Traditionally, selection into medical education professions has focused primarily upon academic ability alone. This approach has been questioned more recently, as although academic attainment predicts performance early in training, research shows it has less predictive power for demonstrating competence in postgraduate clinical practice. Such evidence, coupled with an increasing focus on individuals working in healthcare roles displaying the core values of compassionate care, benevolence and respect, illustrates that individuals should be selected on attributes other than academic ability alone. Moreover, there are mounting calls to widen access to medicine, to ensure that selection methods do not unfairly disadvantage individuals from specific groups (e.g. regarding ethnicity or socio-economic status), so that the future workforce adequately represents society as a whole. These drivers necessitate a method of assessment that allows individuals to be selected on important non-academic attributes that are desirable in healthcare professionals, in a fair, reliable and valid way. [Table: see text] What are SJTs? Situational judgement tests (SJTs) are tests used to assess individuals' reactions to a number of hypothetical role-relevant scenarios, which reflect situations candidates are likely to encounter in the target role. These scenarios are based on a detailed analysis of the role and should be developed in collaboration with subject matter experts, in order to accurately assess the key attributes that are associated with competent performance. From a theoretical perspective, SJTs are believed to measure prosocial Implicit Trait Policies (ITPs), which are shaped by socialisation processes that teach the utility of expressing certain traits in different settings such as agreeable expressions (e.g. helping others in need), or disagreeable actions (e.g. advancing ones own interest at others, expense). Are SJTs reliable, valid and fair? Several studies, including good quality meta-analytic and longitudinal research, consistently show that SJTs used in many different occupational groups are reliable and valid. Although there is over 40 years of research evidence available on SJTs, it is only within the past 10 years that SJTs have been used for recruitment into medicine. Specifically, evidence consistently shows that SJTs used in medical selection have good reliability, and predict performance across a range of medical professions, including performance in general practice, in early years (foundation training as a junior doctor) and for medical school admissions. In addition, SJTs have been found to have significant added value (incremental validity) over and above other selection methods such as knowledge tests, measures of cognitive ability, personality tests and application forms. Regarding differential attainment, generally SJTs have been found to have lower adverse impact compared to other selection methods, such as cognitive ability tests. SJTs have the benefit of being appropriate both for use in selection where candidates are novices (i.e. have no prior role experience or knowledge such as in medical school admissions) as well as settings where candidates have substantial job knowledge and specific experience (as in postgraduate recruitment for more senior roles). An SJT specification (e.g. scenario content, response instructions and format) may differ depending on the level of job knowledge required. Research consistently shows that SJTs are usually found to be positively received by candidates compared to other selection tests such as cognitive ability and personality tests. Practically, SJTs are difficult to design effectively, and significant expertise is required to build a reliable and valid SJT. Once designed however, SJTs are cost efficient to administer to large numbers of candidates compared to other tests of non-academic attributes (e.g. personal statements, structured interviews), as they are standardised and can be computer-delivered and machine-marked

Affective state influences retrieval-induced forgetting for integrated knowledge

Selectively testing parts of learned materials can impair later memory for nontested materials. Research has shown that such retrieval-induced forgetting occurs for low-integrated materials but may be prevented for high-integrated materials. However, previous research has neglected one factor that is ubiquitous in real-life testing: affective stat

Recognition memory and source memory in autism spectrum disorder: A study of the intention superiority and enactments effects

It is well established that neurotypical individuals generally show better memory for actions they have performed than actions they have observed others perform or merely read about, a so-called “enactment effect”. Strikingly, research has also shown that neurotypical individuals demonstrate superior memory for actions they intend to perform in the future (but have not yet performed), an effect commonly known as the “intention superiority effect”. Although the enactment effect has been studied among people with ASD, the current study is the first to investigate the intention superiority effect in this disorder. This is surprising given the potential importance this issue has for general theory development, as well as for clinical practice. As such, this study aimed to assess the intention superiority and enactment effects in twenty-two children with ASD, and 20 IQ/age-matched neurotypical children. The results showed that children with ASD demonstrated not only undiminished enactment effects in recognition and source memory, but also (surprisingly for some theories) typical intention superiority effects. The implications of these results for theory, as well as clinical practice, are discussed

What you know can influence what you are going to know (especially for older adults)

Stimuli related to an individual's knowledge/experience are often more memorable than abstract stimuli, particularly for older adults. This has been found when material that is congruent with knowledge is contrasted with material that is incongruent with knowledge, but there is little research on a possible graded effect of congruency. The present study manipulated the degree of congruency of study material with participants’ knowledge. Young and older participants associated two famous names to nonfamous faces, where the similarity between the nonfamous faces and the real famous individuals varied. These associations were incrementally easier to remember as the name-face combinations became more congruent with prior knowledge, demonstrating a graded congruency effect, as opposed to an effect based simply on the presence or absence of associations to prior knowledge. Older adults tended to show greater susceptibility to the effect than young adults, with a significant age difference for extreme stimuli, in line with previous literature showing that schematic support in memory tasks particularly benefits older adults

A general computational method for robustness analysis with applications to synthetic gene networks

Motivation: Robustness is the capacity of a system to maintain a function in the face of perturbations. It is essential for the correct functioning of natural and engineered biological systems. Robustness is generally defined in an ad hoc, problem-dependent manner, thus hampering the fruitful development of a theory of biological robustness, recently advocated by Kitano

ABCD Neurocognitive Prediction Challenge 2019: Predicting individual fluid intelligence scores from structural MRI using probabilistic segmentation and kernel ridge regression

We applied several regression and deep learning methods to predict fluid intelligence scores from T1-weighted MRI scans as part of the ABCD Neurocognitive Prediction Challenge (ABCD-NP-Challenge) 2019. We used voxel intensities and probabilistic tissue-type labels derived from these as features to train the models. The best predictive performance (lowest mean-squared error) came from Kernel Ridge Regression (KRR; $\lambda=10$), which produced a mean-squared error of 69.7204 on the validation set and 92.1298 on the test set. This placed our group in the fifth position on the validation leader board and first place on the final (test) leader board.Comment: Winning entry in the ABCD Neurocognitive Prediction Challenge at MICCAI 2019. 7 pages plus references, 3 figures, 1 tabl

Scoring method of a Situational Judgment Test:influence on internal consistency reliability, adverse impact and correlation with personality?

textabstractSituational Judgment Tests (SJTs) are increasingly used for medical school selection. Scoring an SJT is more complicated than scoring a knowledge test, because there are no objectively correct answers. The scoring method of an SJT may influence the construct and concurrent validity and the adverse impact with respect to non-traditional students. Previous research has compared only a small number of scoring methods and has not studied the effect of scoring method on internal consistency reliability. This study compared 28 different scoring methods for a rating SJT on internal consistency reliability, adverse impact and correlation with personality. The scoring methods varied on four aspects: the way of controlling for systematic error, and the type of reference group, distance and central tendency statistic. All scoring methods were applied to a previously validated integrity-based SJT, administered to 931 medical school applicants. Internal consistency reliability varied between .33 and .73, which is likely explained by the dependence of coefficient alpha on the total score variance. All scoring methods led to significantly higher scores for the ethnic majority than for the non-Western minorities, with effect sizes ranging from 0.48 to 0.66. Eighteen scoring methods showed a significant small positive correlation with agreeableness. Four scoring methods showed a significant small positive correlation with conscientiousness. The way of controlling for systematic error was the most influential scoring method aspect. These results suggest that the increased use of SJTs for selection into medical school must be accompanied by a thorough examination of the scoring method to be used

Spontaneous and deliberate future thinking: A dual process account

© 2019 Springer Nature.This is the final published version of an article published in Psychological Research, licensed under a Creative Commons Attri-bution 4.0 International License. Available online at: https://doi.org/10.1007/s00426-019-01262-7.In this article, we address an apparent paradox in the literature on mental time travel and mind-wandering: How is it possible that future thinking is both constructive, yet often experienced as occurring spontaneously? We identify and describe two ‘routes’ whereby episodic future thoughts are brought to consciousness, with each of the ‘routes’ being associated with separable cognitive processes and functions. Voluntary future thinking relies on controlled, deliberate and slow cognitive processing. The other, termed involuntary or spontaneous future thinking, relies on automatic processes that allows ‘fully-fledged’ episodic future thoughts to freely come to mind, often triggered by internal or external cues. To unravel the paradox, we propose that the majority of spontaneous future thoughts are ‘pre-made’ (i.e., each spontaneous future thought is a re-iteration of a previously constructed future event), and therefore based on simple, well-understood, memory processes. We also propose that the pre-made hypothesis explains why spontaneous future thoughts occur rapidly, are similar to involuntary memories, and predominantly about upcoming tasks and goals. We also raise the possibility that spontaneous future thinking is the default mode of imagining the future. This dual process approach complements and extends standard theoretical approaches that emphasise constructive simulation, and outlines novel opportunities for researchers examining voluntary and spontaneous forms of future thinking.Peer reviewe

Chronic depression: development and evaluation of the luebeck questionnaire for recording preoperational thinking (LQPT)

<p>Abstract</p> <p>Background</p> <p>A standardized instrument for recording the specific cognitive psychopathology of chronically depressed patients has not yet been developed. Up until now, preoperational thinking of chronically depressed patients has only been described in case studies, or through the external observations of therapists. The aim of this study was to develop and evaluate a standardized self-assessment instrument for measuring preoperational thinking that sufficiently conforms to the quality criteria for test theory.</p> <p>Methods</p> <p>The "Luebeck Questionnaire for Recording Preoperational Thinking (LQPT)" was developed and evaluated using a german sample consisting of 30 episodically depressed, 30 chronically depressed and 30 healthy volunteers. As an initial step the questionnaire was subjected to an item analysis and a final test form was compiled. In a second step, reliability and validity tests were performed.</p> <p>Results</p> <p>Overall, the results of this study showed that the LQPT is a useful, reliable and valid instrument. The reliability (split-half reliability 0.885; internal consistency 0.901) and the correlations with other instruments for measuring related constructs (control beliefs, interpersonal problems, stress management) proved to be satisfactory. Chronically depressed patients, episodically depressed patients and healthy volunteers could be distinguished from one another in a statistically significant manner (p < 0.001).</p> <p>Conclusion</p> <p>The questionnaire fulfilled the classical test quality criteria. With the LQPT there is an opportunity to test the theory underlying the CBASP model.</p